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Abstract 

Background: The diverse set of human brain structure and function analysis methods represents a difficult 
challenge for reconciling multiple views of neuroanatomical organization. While different views of organization are 
expected and valid, no widely adopted approach exists to harmonize different brain labeling protocols and 
terminologies. Our approach uses the natural organizing framework provided by anatomical structure to correlate 
terminologies commonly used in neuroimaging. 

Description: The Foundational Model of Anatomy (FMA) Ontology provides a semantic framework for representing 
the anatomical entities and relationships that constitute the phenotypic organization of the human body. In this 
paper we describe recent enhancements to the neuroanatomical content of the FMA that models cytoarchitectural 
and morphological regions of the cerebral cortex, as well as white matter structure and connectivity. This modeling 
effort is driven by the need to correlate and reconcile the terms used in neuroanatomical labeling protocols. By 
providing an ontological framework that harmonizes multiple views of neuroanatomical organization, the FMA 
provides developers with reusable and computable knowledge for a range of biomedical applications. 

Conclusions: A requirement for facilitating the integration of basic and clinical neuroscience data from diverse 
sources is a well-structured ontology that can incorporate, organize, and associate neuroanatomical data. We 
applied the ontological framework of the FMA to align the vocabularies used by several human brain atlases, and 
to encode emerging knowledge about structural connectivity in the brain. We highlighted several use cases of 
these extensions, including ontology reuse, neuroimaging data annotation, and organizing 3D brain models. 

Keywords: Data integration, Neuroanatomy, Neuroscience, Ontology, Brain atlas, Neuroinformatics, Information 
retrieval, mri 



Background 

Large-scale human brain imaging initiatives are generat- 
ing Big Data to characterize normal and neuropsychi- 
atric brain structure and function. The Alzheimer's 
Disease Neuroimaging Initiative (ADNI, [1]), Human 
Connectome Project (HCP, [2]), NKI-Rockland Sample 
[3], and others provide researchers with unprecedented 
access to massive amounts of shared neuroimaging data. 
While tools and methods are available to support the 
visualization [4-8], data management [9-13] and analysis 
[14-17] of shared or privately collected neuroimaging 
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data, these tools use different approaches to define, seg- 
ment, and label neuroanatomical structures. 

One important component of research in this domain 
involves the development of digital brain atlases, which 
provide both a template brain and neuroanatomical la- 
bels in a standard coordinate system. Imaging data from 
individual participants are aligned to the template and 
brain region labels are propagated over to provide con- 
text to observed features in the data (e.g., location of ac- 
tivation foci). Atlases (i.e., the brain template and 
anatomical label pair) can be based on manual or auto- 
matically labeled brain regions that are derived using 
volume-based or surface-based methods. Each brain 
atlas develops, adopts, or refines an anatomical labeling 
protocol [18-24]. As a result, the labeling protocols used 
to define the boundaries of neuroanatomical regions can 
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vary widely across brain atlases, so collections of ana- 
tomical entities from different labeling schemes do not 
always stand in a relation that allows a one-to-one map- 
ping. Thus, data annotated with labels from different at- 
lases are difficult to compare based on labels alone. 

Previous efforts to reconcile terminologies in neuroim- 
aging, referred to as the brain atlas concordance problem, 
have taken both quantitative and qualitative approaches. 
Taking a quantitative, bipartite graph approach, Bohland 
et al. demonstrated that different brain atlas labeling 
schemes lack a high degree of spatial concordance when 
comparing labels that seemingly refer to the same anato- 
mical structure [25]. Qualitative approaches, such as our 
own, organize anatomical labels through synonymy, rela- 
tions, and class hierarchies that provide practical utility 
(e.g., information retrieval and data integration) without 
resolving fine-grained spatial discrepancies. These ap- 
proaches are complementary and both will be necessary in 
identifying a satisfactory solution to the brain atlas con- 
cordance problem. 

To improve our symbolic model of the brain atlas con- 
cordance problem the labeling protocols from each brain 
atlas need to be made explicit. However, the labeling 
protocols that define anatomical structure boundaries in 
brain atlases are generally published in natural language 
(i.e., as a manuscript) and lack the term definitions and 
relationships provided by a machine-readable ontology 
framework. Neuroimaging data and information encoded 
by these terms cannot be accurately interpreted, com- 
pared, correlated and applied across different studies. A 
similar standardization issue faces the development of 
white matter connectivity atlases [26,27], in which our 
understanding of human brain connectivity is rapidly 
evolving. As new white matter analysis methods and la- 
beling protocols are developed, a proliferation of terms 
to label newly identified structures in white matter at- 
lases will likely occur. 

A robust semantic framework is needed to explicitly 
represent the anatomical labels from different atlases 
using relationships that describe anatomical structure. 
Our goal is to provide such a framework for human 
neuroimaging that will facilitate the integration and 
harmonization of data registered to standard coordinate 
systems with labels for structures in human brain 
atlases. 

Approaches to labeling brain structures 

We selected brain atlases that are widely used in the hu- 
man brain mapping community and harmonized the 
terms used in each atlas' labeling scheme with the ana- 
tomical structures modeled in the Foundational Model 
of Anatomy (FMA) Ontology. In this section, we provide 
a summary of brain labeling protocols that describe the 
anatomical knowledge and spatial relationships encoded 



in the Talairach Daemon, Desikan-Killiany (i.e., FreeSur- 
fer), and Anatomical Automatic Labeling (AAL) atlases, 
as well as NeuroLex. We conclude with a proposal for 
harmonizing all atlas and NeuroLex terms with classes 
in the FMA ontology. 

Talairach daemon labels 

The Talairach Daemon (TD) is an information system 
that provides a mapping between 3D coordinates (i.e., 
Talairach coordinates) and specific brain structure labels 
[28]. It is a digital representation of the original Talair- 
ach atlas [19] that is hierarchically organized into five 
levels: 

1. Hemisphere 

2. Lobe 

3. Gyrus 

4. Tissue type 

5. Cell type 

For example, the label "Right Cerebrum. Temporal Lobe. 
Inferior Temporal Gyrus.Gray Matter. Br odmann area 20" 
represents a number of 3D coordinates in the Brodmann 
area 20 cell-type level, the gray matter tissue-type level 
and so on. While this approach has been broadly applied 
in human brain mapping, there are limitations when nor- 
malizing patient MRI scans due to natural morphological 
differences between individuals. 

Desikan-Killiany atlas 

The Desikan-Killiany (DK, [29]) atlas is a gyral, surface- 
based panellation scheme for labeling anatomical MRI 
scans. The anatomical labeling protocol was manually 
applied to 40 MRI scans to build a template brain with 
labels for 34 cortical regions of interest (ROI) per hemi- 
sphere. This atlas is packaged with the FreeSurfer MRI 
data analysis package [30] that provides researchers with 
access to a variety of image processing tools that in- 
cludes labeling anatomical ROIs with a predefined set of 
terms. 

Automated anatomical labeling 

The Automated Anatomical Labeling (AAL) brain 
atlas provides labels for 90 anatomical regions of 
interest (45 per hemisphere) from a single participant 
using magnetic resonance imaging (MRI) [20]. Ana- 
tomical structures (45 per hemisphere) were identified 
in a high-resolution MRI by manually tracing struc- 
tures in each slice of a 3D volume. The AAL Toolbox 
for the Statistical Parametric Mapping Matlab package 
[17,31] provides researchers with a method for label- 
ing brain regions in their data using the AAL proto- 
col and corresponding vocabulary. 
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NIFSTD and NeuroLex 

The Neuroscience Information Framework (NIF) stand- 
ard ontologies (NIFSTD) are developed to provide a 
consistent source of terminology for neuroscience con- 
cepts [32]. NIFSTD is not a brain labeling protocol nor 
is it tied to a particular spatial arrangement of brain re- 
gions, but is a collection of brain region labels and 
inter-relationships. Neurolex also represents a general 
mammalian hierarchy of brain parts, with each struc- 
ture assigned a taxon rank at which it is generally con- 
sidered to hold, whereas other ontologies, like the 
FMA, are more species specific. NIFSTD is a formal 
ontology constructed through the import of commu- 
nity ontologies with specific extensions for neuro- 
science, covering the major domains of neuroscience 
[32,33]. For community contributions, NIF maintains 
the Neurolex lexicon, where each entity within the 
ontology is exposed as a wild page (http://neurolex.org), 
built using the Semantic Media Wild Platform. Entities 
migrate from Neurolex into the more formal NIFSTD 
ontologies [33]. 

An important feature of the project is to clearly and ex- 
plicitly define all of the terms that are used to describe 
data (e.g., anatomical terms, techniques, organism names). 
The NIF gross anatomy module was largely based on the 
NeuroNames hierarchy [34-36], re-coded in the Web 
Ontology Language (OWL), but has been extensively 
modified through contributions to Neurolex. Neurolex 
serves as a community platform where those with minimal 
knowledge of building ontologies can still contribute their 
expertise. Through programs such as the Neuron Registry 
project of the International Neuroinformatics Coordinat- 
ing Facility (http://incf.org), Neurolex is growing into a 
significant knowledge base for neuroscience. However, 
NeuroLex does not currently provide the framework ne- 
cessary to correlate the terms from different brain labeling 
schemes. 

Our approach: the Foundational Model of 
Anatomy ontology 

The Foundational Model of Anatomy Ontology (FMA) [37] 
is an open source reference ontology for the domain of ana- 
tomy that takes into account, at all biologically salient levels 
of organization, the entities and their spatio-structural rela- 
tions which constitute and form the structural phenotype of 
vertebrates with a special emphasis on the human organism. 
It is based on a unifying theory that explicitly defines ana- 
tomy and its content from the structural point of view. In 
particular, it provides a framework that can incorporate and 
accommodate all entities under the purview of the anatomy 
domain. 

The FMA is implemented as a computable informa- 
tion artifact and is primarily intended for developers of 
terminologies and application ontologies [38] in clinical 



medicine and biomedical research that require anatom- 
ical knowledge. Ontologists primarily value its merits be- 
cause it is both broader and more fine-grained than 
extant anatomy texts or terminologies. For example, the 
FMA models both abstract, high-level concepts and leaf- 
level, fine grained concepts such as "Material anatomical 
entity" and "Brodmann area 1 of left postcentral gyrus", 
respectively. This approach is not entirely consistent 
with the tradition-based representation of anatomy that 
clinical practitioners and biomedical researchers are 
taught in their training. Therefore, the benefits the FMA 
offers to end users are best realized through derived ap- 
plication ontologies [38,39] and biomedical software that 
utilize anatomical knowledge. 

The principled framework provided by the FMA is 
flexible enough to capture the intended semantics of ter- 
minologies developed for more specific purposes. For 
example, application ontologies derived from the FMA 
(e.g., RadLex [40,41]) can be used to reconcile prevalent 
views of anatomy (e.g., radiologists or anatomy teachers) 
with an ontological representation of biological struc- 
ture. Thus, knowledge extracted from the FMA can be 
abstracted to a level that is familiar to individuals in a 
given domain. The FMA can also incorporate annota- 
tions on anatomical entities that provide a mapping to 
external knowledge sources (e.g., ontologies or brain 
atlas terms), as well as a means to correlate between 
mapped terms. A central goal of this paper is to demon- 
strate how the FMA can be used to harmonize the grow- 
ing number of neuroscience terminologies and provide a 
framework and use cases for developing useful biomed- 
ical applications. 

Construction and content 
Authoring environment 

The FMA information artifact is implemented in 
Frames using Protege, an authoring and editing envir- 
onment created by members of the Stanford Biomedical 
Informatics Group [42]. Currently, the master copy of 
the FMA is stored in a relational MySQL database; 
however, many major biomedical ontologies (e.g., those 
in the OBO Foundry [43]) are now developed using 
OWL. OWL is now the standard language for describ- 
ing ontologies on the Web, and there are ongoing 
efforts to translate the FMA into OWL. Previous at- 
tempts succeeded in creating a version of the FMA in 
OWL Full [44], and more recently a subset of the FMA 
was converted into OWL 2 [45]. The migration of the 
entire FMA into OWL 2 would greatly facilitate inte- 
gration and interoperability with external ontologies 
and Semantic Web-related technologies. A strategy for 
this conversion is in early development, thus outside 
the scope of this paper; however, even without this 
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migration, the current Frames version allows us to rec- 
oncile existing neuroanatomy terminologies. 

Enhancing neuroanatomy content in the FMA 

The neuroanatomical content of the FMA was enhanced 
with detailed modeling for cerebral hemisphere brain la- 
beling schemes, cerebral sulci, white matter structures, 
and neural connectivity relationships. These enhance- 
ments were designed to support use cases in human 
brain imaging by incorporating four major terminolo- 
gies, described above, that are widely used for annotating 
neuro-related data (i.e., Talairach, Desikan-Killiany, AAL, 
NeuroLex). Our goal was to augment the FMA with the 
spatio- structural properties needed to represent different 
brain labeling schemes, while maintaining a single co- 
herent framework. By accommodating different views 
within the same framework, we can use the enhanced 
FMA properties to correlate disparate brain labeling 
schemes. In the next section we describe the extension 
in more detail. Note that in this paper we represent 
FMA classes in Courier New font and relationships in 
bold italic. 

Cerebral hemisphere labeling 

For a given anatomical labeling protocol, the terms used 
to label or annotate brain structures may refer to neuro- 
anatomical entities at different levels of granularity or 
using disparate features (e.g., morphological vs. cyto- 
architectural) to define the boundaries of specific struc- 
tures and their corresponding labels. This means that 
there may not be a direct or one-to-one correspondence 
between the terms from different atlases or terminologies. 



However, by mapping these terms to the FMA, the onto- 
logical structure of the FMA explicitly defines what en- 
tities are represented by the terms and how they correlate 
with one another according to the properties and spatio- 
structural relationships established for them in the FMA. 
In this section we provide a technical overview of how the 
FMA was enhanced to accommodate and correlate differ- 
ent brain labeling protocols. 

To provide a mapping between different terminologies 
we used Protege to introduce property slots (e.g., source 
names and unique identifiers) that link FMA classes to cor- 
responding annotation terms (Figure 1). The labels used in 
each labeling scheme were manually correlated with a cor- 
responding FMA term. A list of potential mappings was 
semi-automatically generated using direct string matching, 
synonymy mapping, lexical mapping, or by interpreting the 
symbols and abbreviations used in a given labeling protocol 
(e.g. "R" for "Right", "ctx" for "cortex", etc.). 

Mapping NeuroLex 

Using the term matching approach described above, the 
terms from NeuroLex were mapped to a subset of clas- 
ses from the FMA that model neuroanatomical know- 
ledge. For example, Right frontal lobe is a direct 
string match between FMA and NeuroLex, Inferior 
horn of the lateral ventricle in NeuroLex is 
synonymous with Temporal horn of lateral ventricle in 
the FMA, and Lateral occipital cortex in Neu- 
roLex is a lexical match to Cortex of lateral occipital 
gyrus in the FMA. The mappings were then manually in- 
corporated into the FMA by adding specific NeuroLex 
identifiers to the newly defined NeuroLex_ID property. 



Cray matter of neuraxis 
(C)Gray matter layer of neuraxis 
©Cray matter of fore bra in 
©Cray matter of telencephalon 

c Gray matter of diencephalon 
(§)Gray matter of gyrus 

▼ (c)Cray matter of gyrus of frontal lobe 
▼ ©Cray matter of superior frontal gyrus 



f right superior frontal gyrus 



©Cray matter of left superior frontal gyrus 

► 1 c) Cray matter of middle frontal gyrus 

► (c) Cray matter of prece rural gyrus 
» ® Cray matter of straight gyrus 

► ©Cray matter of inferior frontal gyrus 

► ©Cray matter of anterior orbital gyrus 

► ©Cray matter of posterior orbital gyrus 

► ■© Cray matter of medial orbital gyrus 

c Gray matter of lateral orbital gyrus 
» (© Cray matter of frontal lobe proper 

► ©Cray matter of medial frontal gyrus 
» (C) Cray matter of orbital gyrus 

► ©Cray matter of transverse frontopolar gyrus 
» © Cray matter of frontomargmal gyrus 

► ©Olfactory cortex 

► ©Cray matter of gyrus of temporal lobe 

► ©Cray matter of gyrus of parietal lobe 



CMA Label 



RadLex ID 



Talairach 

Talairach 10 

613 



Neurolex 



C 



Right Cerebrum. Frontal Lobe Superior Frontal Cyrus.Gray Matter/ 



C 



DK(Freesurfer) 



V C 



c t x - rti - C_ frontal, s u pen or 
cix-rh-S_fronlal_sup«rior 



Freesurftf ID 

2110 
21S6 



V C 



Source 



AAL ID 



Figure 1 Protege screen capture showing the slots for the different terminologies. In the example, the FMA class Gray matter of right 
superior frontal gyrus maps to Talairach and DK (Freesurfer). 
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Mapping Talairach 

Talairach Daemon annotations explicitly represent five 
levels of partonomy where the level of granularity for 
each neuroanatomical entity is denoted by a period. For 
example, the Talairach label Right Cerebrum. 
Frontal Lobe. Superior Frontal Gyrus. Gray 
Matter. Brodmann area 6 indicates a set of coordi- 
nates located on Right Brodmann area 6, on the 
Right superior frontal gyrus of the Right 
frontal lobe in the Right cerebral hemisphere. 
The actual neuroanatomical entity being represented here is 
"Brodmann area 6 of right superior frontal gyrus", which ex- 
ists in the FMA and is therefore directly mapped to the cor- 
responding Talairach term. 

Where appropriate and necessary in the ontology, we 
added new classes, properties and relations to complete 
the mappings between FMA classes and the different an- 
notation terms [46,47]. This is particularly true for ac- 
commodating and reconciling different labeling schemes 
for the cerebral cortex. For example, the Talairach 
term Right Cerebrum.Frontal Lobe. Superior 
Frontal Gyrus. Gray Matter. Brodmann area 6 
refers to an area in the gray matter of the right su- 
perior frontal gyrus that overlaps with Brodmann area 
6. Whereas the gyrus is subdivided into regions based 
on topographical surface landmarks, Brodmann areas 
are regions defined on the basis of the underlying 
cytoarchitecture or cellular and laminar organization. 

Although both types of regional partitions are in the 
FMA, neither Brodmann area 6 nor the gray matter of 
the right superior frontal gyrus had been partitioned to 
account for the overlap. We therefore reconciled both 
morphological and cytoarchitectural schemes into the 
FMA ontology with the following modeling pattern. 

First, we created a class for the Gray matter of the 
superior frontal gyrus, which overlaps with (i.e., 
hasjregional _part) Brodmann areas 6, 8, 9, 10 and 11 
(Figure 2). Second, we created a class for Brodmann area 
6 and model overlaps with the gray matter of the precentral, 
the superior frontal, the middle frontal, the inferior frontal 
and the medial frontal using hasjregional _part relations 
(Figure 3). 

Going back to our Talairach example above, we 
mapped it to the new FMA class called Brodmann 



area 6 of right superior frontal gyrus which 
is_a Segment of Brodmann area 6 and a regional_- 
part_of both Right Brodmann area 6 and Gray 
matter of right superior frontal gyrus 
(Figure 4). And following the transitive part_of relation 
of Brodmann area 6 of right superior frontal 
gyrus up the FMA part hierarchy reveals that all the 
granularity levels implicitly encoded in the Talairach 
label are explicitly represented in the part hierarchy of 
the FMA (Figure 5). The latter is the kind of information 
that the ontology can provide to facilitate automated 
reasoning by any system. 

Mapping Desikan-Killiany and AAL 

The labels used in FreeSurfer with the Desikan-Killiany 
(DK) atlas contain abbreviations and acronyms such as 
"Ctx", "lh" and "wm" which mean "Cortex", "Left hemi- 
sphere" and "White matter", respectively. For example 
the term "ctx-lh-postcentral" maps to Gray matter of 
left postcentral gyrus. Many of the terms used 
in DK (e.g. ctx-rh-inferiortemporal) and AAL (e.g. Tem- 
poral_Inferior_Right) are customized and specific only to 
their respective projects. Therefore, some semantic inter- 
pretation is required to parse the meaning and intemper- 
ate with other atlas terminologies. In the FMA we provide 
a semantic framework that explicitly declares the intended 
meanings of the terms used. 

We identified anatomical entities (i.e., classes) in the 
FMA that most closely correspond to a given brain atlas 
label. We then elaborated on the properties associated 
with each FMA class to provide additional relationships 
that capture information necessary to correlate with the 
labels from other brain atlases and NeuroLex (e.g., iden- 
tifiers, preferred names, etc.). From the above examples, 
ctx-rh-superiorfrontal from DK is mapped to the FMA 
class Gray matter of right superior frontal 
gyrus and Frontal_superior_right from AAL to FMA 
class Right superior frontal gyrus. 

Note that the structural entities represented by the dif- 
ferent terms are at various levels of granularity, with 
Talairach, FreeSurfer and AAL at the levels of Brodmann 
area, gray matter of cortex, and gyrus, respect- 
ively. Furthermore a laterality attribute is specified for all 
three representations as opposed to NeuroLex, which does 



C) Cray matter of gyrus 

c C ray matter of gyrus of frontal lobe 

► 1 cljffiBTiiftV UliTJtl/l i A! ■W IJCTfl 

► (c) Gray matter of middle frontal gyrus 

► © Cray matter of precentral gyrus 

► © Cray matter of straight gyrus 

► © Gray matter of inferior frontal gyrus 

► ©Gray matter of anterior orbital gyrus 



Regional Part V + 

c Brodmann area 6 of superior frontal gyrus 
© Brodmann area S of superior frontal gyrus 
© Brodmann area 9 of superior frontal gyrus 

c Brodmann area 11 of superior frontal gyrus 
© Brodmann area 10 of superior frontal gyrus 



Figure 2 A listing of regional parts (i.e., Brodmann Areas) for the gray matter of the superior frontal gyrus. 
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fc) Brodmann area 
► ©Brodmann area 1 



Regional Part 



V + 



r 1 c: Brodmann area 2 

► ©Brodmann area 3 

► ©Brodmann area 4 

► ©Brodmann area S 

► IclJAT.ri'itTiTilWAl^ 

► ©Brodmann area 7 

Figure 3 A listing of regional parts (i.e., cortical gyri) that intersect Brodmann Area 6. 



(5) Brodmann area 6 of precentral gyrus 
(c) Brodmann area 6 of inferior frontal gyrus 
:c> Brodmann area 6 of middle frontal gyrus 
c Brodmann area 6 of superior frontal gyrus 
(c) Brodmann area 6 of medial frontal gyrus 



not require left/right attributes. However the FMA has 
the framework to correlate all the entities based on their 
ontological definitions and relationships as shown in 
Figure 6. In this example, the Talairach term is mapped to 
the FMA class Brodmann area 6 of right superior 
frontal gyrus, a part_of Gray matter of right 
superior frontal gyrus, the FMA class referenced 
by DK, which in turn is a part_of the AAL mapped entity 
Right superior frontal gyrus. The non- 
lateralized NeuroLex classes are then mapped via is_a re- 
lation to the lateralized entities represented in the other 
terminologies (e.g., Right superior frontal gyrus 
(AAL) is_a Superior frontal gyrus (NeuroLex)). 

White matter and connectivity relationships 

There are a growing number of human neuroimaging 
techniques from the emerging field of connectomics 
[2,48,49] that can describe white matter connectivity at an 
increasing level of detail. Parallel ontological representa- 
tions are required to capture and accommodate the newly 
derived or updated knowledge models these methods pro- 
vide. This is necessary to establish precise and reliable 
structural-functional correspondence between disparate 



representations of white matter structures. Using new and 
classic neuroanatomical knowledge we have enhanced the 
FMA representation of white matter tracts and connectiv- 
ity relationships between gray and white matter structures. 

Partonomy of white matter structures 

We pursued a comprehensive spatio-structural representa- 
tion of white matter tracts, particularly relating to parton- 
omy and connectivity relationships. A good example 
addressed by this approach relates to the common practice 
of using the same term to represent both the entire tract 
and its segments, as in the case of the Corticospinal 
tract. In cases where only a very specific segment of the 
tract is to be identified, the indiscriminate use of a non- 
exclusive term for its annotation can lead to errors and 
inconsistencies, especially when machine-processing is 
involved. This can be avoided by properly declaring the 
parts of a structure with unique terms assigned to each 
part and only using the structure specific term for annota- 
tion. Figure 7 illustrates this approach using the Corti- 
cospinal tract (i.e., the complete structure) and all of 
its named segments/parts. 



c Segment of Brodmann area 

► A Stgmtfit of Brodmann area 1 

► C) Segment of 6 rod ma nn are a 2 

► C Wqnent Of Brodmann are j 1 

► c Segment of Brodmann area 4 
» C Segment of Brodmann area S 
▼ c Segment of Brodmann area 6 

► (c Brodmann area 6 of precentral gyrus 

* C Brodmann area 6 of inferior frontal gyrus 

► C Brodmann area 6 of middle frontal gyrus 

t c BT Odrnann. area 6 of superior frontal gyrus 

C SfOdmjnn area 6 of k ft super kqt frontal gyrus 

► r Brodmann area 6 of medial frontal gyrus 

► C Brodmann area 6 of frontal lobe 

► C StcxifTunn area 6 of anterior segment of paracentral la 

► c Rtrxlmann area 6 of dorsal pari of precentral gyrus 

► c Brodmann area 6 of lateral part of precentral gyrus 

* <B Brodmann area 6 of ventral part of precentral gyrus 

► c Brodmann area 6 of ongulate gyrus 
* c Segment of Brodmann area 7 

► C Segment of Brodmann area S 
» ©Segment of Brodmann area 9 

► c segment of Brodmann area 10 

► C Segment of Brodmann are a 1 1 



Talairach V C + 

Talairach IO name 

1078 Right Cerebrum Frontal Lobe. Superior Frontal GyrusCray Matter. Brodmann area 6 



V ♦ - Part Of 



Regional Part Of 

c Right Brodmann area 6 
<q> Brodmann area 6 of right frontal lobe 

C Cray matter of right superior frontal gyrus 

Constitutional Part V * - 

(C)Plexiform layer of Brodmann area 6 of right superior frontal gyrus 
C External granular layer of Brodmann area 6 of right superior frontal gyrus 
(C) External pyramidal layer of Brodmann area 6 of right superior frontal gyrus 
c Internal granular layer of Brodmann area 6 of right superior frontal gyrus 
C internal pyramidal layer of Brodmann area 6 of right superior frontal gyrus 
c Murtiform layer of Brodmann area 6 of right superior frontal gyrus 



C' Right Brodmann are 
lie) Bfodmann area 6 o 
c Gray matter of right 



Pan 

c Pie inform layer of B 
(t) External granular la 
C' External pyramidal 
(C) Internal granular la\ 
(e) internal pyramidal i 
C Multiform layer of B 



Receives Projection V +■ 

Ci Dorsal segment of right superior longitudinal fasciculus 



IC 



Constitutional Part Of 



Figure 4 Part relationships of Brodmann area 6 of right superior frontal gyrus. 
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Figure 5 Correlation of Talairach label to part relationships of Brodmann area 6 of right superior frontal gyrus in the FMA. 



Granularity of connectivity relationships 

Connectivity between neuroanatomical entities entails 
relationships at different levels of granularity. Numerous 
terms have been used inconsistently to establish con- 
nectivity relationships between neurons, between nerve 
fibers or tracts and between gray matter structures. 



In this paper we proposed and gave definitions to 
specific connectivity types for different granular entities 
(Table 1). 

At the neuronal level, a neuron can synapsejwith an- 
other neuron or a muscle fiber or a gland cell. Connect- 
ivity is at the subcellular level between the pre-synaptic 
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Figure 6 An example of how terms from brain atlases and vocabularies (right yellow) can be correlated by mapping to the 
corresponding class in the FMA hierarchy. 
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▼ (£) Cervical segment of anterior corticospinal tract 
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©C2 segment of Lateral corticospinal tract 
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Figure 7 Regional partition of the corticospinal tract from the 
brain to the spinal cord. 



membrane of a neurite of a neuron with a post-synaptic 
membrane of a neurite or soma of another neuron or 
with a region of a muscle fiber or a gland cell. White 
matter structures at the nerve or tract-level (i.e., collec- 
tion of axons) projects_to and projects Jrom any region 
of the neuraxis (i.e., a term referring to both brain and 
spinal cord). For example, the Dorsal segment of 
superior longitudinal fasciculus (i.e., SLF I) 
projects Jrom Brodmann area 6 of superior 
frontal gyrus and projects_to Brodmann area 5 of 
superior parietal lobule. Finally, we created tern- 
ary relationship types that model neural connectivity 
between any two regions of the neuroaxis connected by 
white matter. Gray matter structures receives_input Jrom 
and sends_output_to other gray matter structures, as 
shown in Figure 8 for Putamen. 

The connectivity relationships we propose capture the es- 
sential levels needed to express how information is commu- 
nicated throughout the brain. However, several other efforts 
are working on the issue of neural connectivity relations. 
For example, the OBO Relation Ontology [50] proposes re- 
lations such as has Jasciculating_neuron_projection and 
axon_synapsesJn. As additional relationships are defined, 
the FMA will provide a framework to accommodate these 
terms for further refinement of connectivity representation. 

Cerebral sulci 

Among immaterial anatomical entities, particular atten- 
tion was directed to anatomical spaces such as the cere- 
bral sulci. Sulci are defined in different contexts, 
depending on the operational needs of the users. In 
some labeling protocols, sulci are treated as 1-D lines 
that serve as boundaries of gyri, whereas in surface- 
based panellation models they are spaces or grooves 
that surround the gyri. The PALS -B 12 atlas from Caret 
[51], a significant labeling scheme of widespread utility, 
involves the use of sulci to identify and contour "buried" 



Table 1 White matter connectivity terms and definitions 



Innervate A connectivity relation where a neurite of one neuron synapses with a neurite or a region of the soma of another neuron or 

a region of a muscle cell or a gland cell. 

Synapse_with A connectivity relation where there is apposition between the presynaptic membrane of a neurite of one neuron and the 

postsynaptic membrane of one or more neurites of another neuron or a region of a muscle cell or a gland cell and some 
form of neurotransmission is evident between them. 

Projects_to A connectivity relation where individual axons comprising a fiber tract originating from one or more brain regions 

synapse_with neurites or somas of a collection of neurons located in one or more other brain regions. This relation may be 
synonymous with 'terminatejn'. 

Projects_from A connectivity relation where individual axons comprising a fiber tract are parts of a collection of neurons located in one or 

more brain regions. This relation may be synonymous with 'originatejn'. 

Sends_output_to A subproperty of project_to relation where neurotransmission is sent from one brain region to one or more other 
brain regions. 

Receives_input_from A subproperty of project_from relation where neurotransmission is received by one brain region from one or more other 
brain regions. 

Has_pathway A connectivity relation where a collection of neurons located in brain region A sends_output_to a collection of neurons 

located in B via axons comprising the fiber tract from brain region. 
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Figure 8 Connectivity relationships for the Putamen. 



cortex among gyri. Here the term "sulcus" denotes a 3D 
volume, the segments of gyri located in the furrows. We 
disambiguated the representation of sulcus by treating it 
as an anatomical space and for the area of the gyrus in 
the sulcus, we regarded it as an anatomical structure 
that is part of the gyrus and classified it as sulcal seg- 
ment of a gyrus under Segment of gyrus of brain. 
As shown in Figure 9, the middle frontal gyrus consists 
of several regional parts or segments, one of which is 
Sulcal segment of middle frontal gyrus and 
the rest are parts of the gyrus that are externally visible. 
With this approach, the entire middle frontal sulcus can 



c Segment of cerebral hemisphere 

► ©Lobe of cerebral hemisphere 

► © Segment of cerebral lobe 

► ©Cyrus of brain 

▼ ©Segment of gyrus of brain 
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Figure 9 Regional parts of the middle frontal gyrus. Sulcal 
segment of middle frontal gyrus is the part located in the sulci. 



be modeled as belonging to two gyri - both the Sulcal 
segment of middle frontal gyrus and Sulcal segment of 
inferior frontal gyrus. 

Utility and discussion 

Extensions to the neuroanatomical axis of the FMA were 
motivated by use cases in ontology development, knowledge 
retrieval, and data integration. In this section we describe 
several use cases for our work and discuss how reusable and 
computable anatomical knowledge captured in the ontology 
can be utilized to solve real-world problems. 

Neuroanatomical knowledge reuse 

The FMA is a reference ontology that can be imported into 
other ontologies as a way to reuse curated knowledge about 
anatomy [37]. RadLex [40] is an ontology composed of 
standard terms for the domain of radiology, including im- 
aging observations, characteristics, and techniques, as well 
as diseases, radiology reporting terminology, and anatomy. 
For anatomy, RadLex incorporates a subset of the FMA 
that is relevant to the radiological scale of analysis [41]. 

RadLex also contains knowledge beyond anatomy that 
enables additional radiology oriented use cases such as hu- 
man brain imaging. For example, a digital brain label can 
indicate the anatomical structure that a set of image coor- 
dinates pertains to in a brain template, whereas RadLex 
can be used to describe key aspects of a neurological im- 
aging examination including modality, technique, visual 
features, anatomy, findings, and pathology. By incorporat- 
ing neuroanatomical content from the FMA, RadLex en- 
ables rich dataset annotations and provides a means to 
correlate and integrate the findings with other external 
data and studies as discussed in the following section. 

Ontological knowledge retrieval 

To leverage the knowledge we encoded into the FMA 
the ontology can be accessed using a query engine. For 
this purpose we used the Query Integrator (QI) as an 
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underlying technology [52] to query the neuroanatomy 
ical content of the FMA as represented in OWL-FulL 
The QI is a Web-based query management and execution 
system that enables queries over any Web-accessible data 
or knowledge source (e.g. ontology). The QI supports 
multiple query languages, including SPARQL [53] for RDF 
[54] data sources. QI queries may be stored for reuse, exe- 
cuted via RESTful Web services, and chained together to 
form query pipelines. This latter capability allows the re- 
sults of ontology queries to be joined with data queries to 
answer more interesting questions than are possible based 
on the data alone. 

Dataset annotation and "intelligent" query 

As reported in Turner et al. [47], the FMA was used to 
annotate a large dataset of task-based functional MRI 
(fMRI) signal activations in subjects with schizophrenia 
and healthy subjects. The activation locations were an- 
notated with neuroanatomical labels from the Talairach 
Daemon [28,55]. These labels combined cytoarchitec- 
tural labels from one method for labeling brain regions, 
with morphological terms based on sulci and gyri. The 
FMA was extended to include intersections between 
label pairs when regions overlap. For example, within 
areas covered by the label Inferior temporal 



gyrus exist areas covered by the label Brodmann 
area 2 0. Therefore, part_ of the Inferior temporal 
gyrus is part_of Brodmann area 2 0, and part_of the 
Inferior temporal gyrus is not in Brodmann 
area 2 0. Conversely, Brodmann area 2 0 has parts 
that are in the Inferior temporal gyrus and parts 
of Brodmann area 2 0 which are in other gyri. This ex- 
tension of the ontology in conjunction with a reasoning 
engine allowed novel questions to be asked about the 
data. 

3D anatomical model management 

In biomedical education and research, 3D surface models 
are useful and commonplace. For example, a researcher 
using the brain atlases described above may generate 
neuroanatomical surface models from a patients MRI, 
where each model is a different brain region. While these 
models can be organized using naming conventions or dir- 
ectory structures, it may be more meaningful to annotate 
models using terms from the FMA. Similar to our work 
on annotating tabular datasets, the knowledge in the FMA 
can be queried and used to reason about which 3D models 
to select and display in a 3D scene. We have developed a 
prototype scene generation system that implements this 
idea and will allow users to create Web-based 3D scenes 
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Figure 10 Screenshot of the 3D model asset manager component of the scene generator displaying a list of asset sets on the 
and the selected asset set on the left (AAL - Brain). Scenes are generated from the selected asset set based on queries to the FMA. 
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using the results of queries over the FMA or data sets an- 
notated with FMA identifiers (Figure 10). 

The system provides access to several biomedical 3D 
model sets, including models generated from the brain 
atlases described above (e.g., AAL and DK) and allows 
users to upload their own models. Scenes can be con- 
structed by hand or using queries, and queries can be 
shared between users and customized using parameters. 
Since all scenes are rendered using WebGL, they can 
easily be embedded within any website or Web-based 
publication. For example, users of this system can access 
knowledge in the FMA to generate a scene showing all 
portions of the brain with blood supply from the middle 
cerebral artery or all structures connected by a given 
white matter tract. Similarly, scenes can be generated to 
display different model sets of the same structures such 
as 3D models of the left hemisphere in the DK 
(Figure 11) and AAL anatomical labeling schemes 
(Figure 12). 

This tool currently provides users with the ability to 
manage 3D model sets, query annotated models, and 
visualize query results as 3D scenes. As this tool matures 
it will also incorporate support for building scenes from 
connectivity relationships, visualizing the correlation be- 
tween model sets, and displaying volumetric anatomical 
images. In addition, our tool provides model management 
features that facilitate sharing and reuse of model sets. 
These tools are also useful in validating and exploring the 
FMA and other terminologies, as well as model sets based 




Figure 11 A view of the DK left hemisphere panellation with 

the left precuneus selected. A link to this scene can be found 

at: http://purl.org/sig/docs/neurofma-jbs. 
\ J 




Figure 12 A view of the AAL left hemisphere labeling with the 

left superior temporal gyrus selected. A link to this scene can be 

found at: http://purl.org/sig/docs/neurofma-jbs. 
L J 



on these. Misalignments, missing structures, and issues 
with coordinate sets readily become apparent in query- 
driven scenes and, in many cases, can be remedied from 
within the tool and re-exported for use elsewhere. Simi- 
larly, visualizations can be composed that relate the struc- 
tures defined in different terminologies to one another. As 
mentioned, this system is currently under development; 
we anticipate publishing and releasing it to the commu- 
nity in the near future. Links to any publications associ- 
ated with this tool will be available on the supplementary 
materials page (http://purl.org/sig/docs/neurofma-jbs). 

Conclusions 

We demonstrated that the framework provided by the 
FMA ontology can be extended to accommodate and cor- 
relate the terms used in three human brain labeling 
schemes and NeuroLex. We then used the enhanced FMA 
to highlight use-cases for neuroanatomical knowledge re- 
use and retrieval. The FMA was found to sufficiently cap- 
ture and clarify the relationships between different 



Nichols et al. Journal of Biomedical Semantics 2014, 5:1 
http://www.jbiomedsem.eom/content/5/1/1 



Page 12 of 13 



anatomical labeling schemes necessary to fulfill the use 
cases. 

As a result, the disciplined and principled approach in 
the FMA lays the foundation for: 

1. An ontology-based standard for anatomical data 
annotation 

2. Queries that can use the ontology to infer 
anatomical relationships in data 

3. Data visualization systems that incorporate 
anatomical knowledge 

4. A "meta-atlas" that harmonizes different brain 
labeling protocols 

5. A unifying anatomical framework for integrating a 
variety of biomedical data 

While this effort advances state-of-the-art knowledge 
representations of human neuroanatomy, further work is 
needed to address the brain atlas concordance problem. 
Symbolic representations of anatomical labeling schemes 
alone are not sufficient to model the spatial information 
in brain atlases. Computational frameworks, such as 
proposed by Bohland, et al. [25], provide quantitative 
measures of spatial concordance but do not address the 
issue of lexical mappings. A hybrid framework that inte- 
grates quantitative information with ontologies would 
offer a more comprehensive solution to reconciling 
neuroanatomical labeling schemes. Additionally, the 
purely structural approach taken by the FMA only ac- 
commodates anatomical descriptors, and the need for 
functional divisions of the brain calls for future develop- 
ment of a "functional brain labeling ontology". 
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